1 CLAIMS 

2 1. A method for image retrieval using a statistical bigram correlation model, 

3 the method comprising: 

4 receiving a plurality of images responsive to multiple search sessions; 

5 determining whether the images are semantically relevant images via 

6 relevance feedback; and 

7 | estimating a respective semantic correlation between each of at least one 

8 pair of the images with a respective bigram frequency, each respective bigram 

y 9 frequency being based on multiple search sessions in which each image of the pair 

%j ! 

« 10 is indicated to be a semantically relevant image. 

In 

^12 2. A method as recited in claim 1, further comprising: 

Pi 

^13 assigning a respective ranking score to each of the images based at least in 

iU 14 part on the respective semantic correlation corresponding to the image; and 

n 

m 1 5 I displaying only those images with a highest range of ranking scores. 

16 

17 3. A method as recited in claim 1, further comprising, responsive to a search 

18 session, dynamically updating the respective bigram frequency corresponding to 

19 two of the images. 
20 

21 4. A method as recited in claim 1, wherein the respective semantic correlation 

22 is: (a) a positive correlation between two semantically relevant images; (b) a 

23 negative correlation between a semantically relevant image and a semantically 

24 irrelevant image; and (c) no correlation otherwise. 
25 
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5. A method as recited in claim 1 : 

wherein the respective semantic correlation is performed offline or online 
to calculate unigram and bigram frequencies from relevance feedback information, 
the unigram frequency being based on relevance feedback to a session of the 
multiple search sessions, the unigram frequency indicating that each respective 
image of the images is either semantically relevant to the session, semantically 
less relevant to the session, or a non-feedback image with respect to the session; 
and 

wherein each respective bigram frequency is based on a pair of unigram 
frequencies. 

6. A method as recited in claim 1, wherein estimating the respective semantic 
correlation further comprises: 

associating a respective unigram frequency with each of the images, the 
unigram frequency indicating that each respective image of the images is either 
semantically relevant, semantically less relevant, or a non-feedback image, the 
unigram frequency being based on relevance feedback to a session of the multiple 
search sessions; and 

wherein each respective bigram frequency is based on a pair of unigram 
frequencies. 



Iee@hayes poc 50*324*256 



25 



021 1021 144 MS1S80US.PATAPP.DOC 



1 7. A method as recited in claim 1, wherein estimating the respective semantic 

2 correlation further comprises: 

3 associating a respective unigram frequency with each of the images, the 

4 unigram frequency indicating that each respective image of the images is either 

5 semantically relevant, semantically less relevant, or a non-feedback image, the 

6 unigram frequency being based on relevance feedback to a session of the multiple 

7 search sessions; 

8 determining a maximum frequency from a maximum value of the bigram 
M 5 9 and unigram frequencies; and 

s 

J^IO wherein the respective semantic correlation is further based on the 

+: 1 1 maximum frequency, 
f 12 

L13 8. A method as recited in claim 1, further comprising identifying, for each 

ry 

^14 image obtained responsive to one or more search sessions of the multiple search 



15 sessions, a respective semantic support based on a similarity measure and/or the 

fU 

16 respective semantic correlation, the similarity measure corresponding to a 

17 similarity of a respective feature vector of the image and a search query 

1 8 corresponding to the session. 
19 
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10. A method as recited in claim 1, wherein estimating the respective semantic 
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wherein are two images, B(I 9 J) is their bigram frequency, is the 
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unigram frequency of image is the maximum frequency, R(I,J) is the 


23 


correlation between image I and J. 


24 
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1 11. A method as recited in claim 1, wherein each respective bigram frequency 

2 is based on a pair of unigram frequencies, and wherein the method further 

3 comprises performing the respective semantic correlation offline by: 

4 (a) initializing all unigram and bigram frequencies to zero; 

5 (b) clustering search sessions with a same query into groups; 

6 (c) calculating unigram counts within a group; 

7 (d) updating unigram frequencies ; 

8 (e) updating bigram frequencies; 
□ 9 (f) repeating operations (c), (d), and (f) for all session groups; 
%J10 (g) setting all negative unigram and bigram frequencies to zero; and 
-|J 1 1 (h) calculating each respective semantic correlation based on results of (a) 

m through (f). 
113 
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1 12. A method as recited in claim 1, wherein each respective bigram frequency 

2 is based on a pair of unigram frequencies, wherein C(I) is a unigram count of 

3 image /, and wherein the method further comprises performing the respective 

4 semantic correlation offline by: 

5 (a) initializing C(I) to zero (0); 

(b) iteratively updating C(I) for every session in a group such that: 
C(I) = C(I) + 1 , if image / is labeled as relevant in a session; 
□ 8 C(I) = C(I) - 1 , if image / is labeled as irrelevant in a session; and 

9 C(7) is unchanged otherwise. 

£ 10 (c) repeating (b) for every image of the images; 

L. 1 1 (d) updating each respective unigram frequencies as U(I) = U (I) + C(I) : 

M=12 (e) updating each respective bigram frequency of an image pair such that: 

(13 B(I,J) = B(I 9 J) + min{C(/) 5 C(J)} , if C(/) > 0,C(J) > 0, 

14 B(I,J) = B(I,J) - min{C(/) -C(J)} , if C(7) > 0 ? C(J) < 0, 

15 B(I,J) = B(I,J) - min{-C(/) 5 C(J)} , if C(I) < 0,C(J) > 0, and 

16 B(I,J) = B(I,J) , otherwise; and 

17 wherein I,J are two images, B(I,J) is their bigram frequency, and 

18 U (I) is the unigram frequency of image /. 
19 
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13. A method as recited in claim 1, wherein each respective bigram frequency 
is based on a pair of unigram frequencies, and wherein the method further 
comprises performing the respective semantic correlation online by: 

(a) calculating unigram counts in a particular search session; 

(b) updating unigram frequencies; 

(c) updating bigram frequencies; and 

(d) updating each respective semantic correlation between each of the 
images based on results of (a) through (c). 
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1 14. A method as recited in claim 1 5 wherein each respective bigram frequency 

2 is based on a pair of unigram frequencies, wherein C(7) is a unigram count of 

3 image /, wherein U(I) is a unigram frequency of image /, wherein B(I, J) is a 

4 bigram frequency of image / and J, wherein a session group comprises a single 

5 search session, and wherein the method further comprises performing the 

6 respective semantic correlation online by: 

7 I (a) responsive to determining that there is a user log, updating calculating 

8 each respective unigram and bigram frequency according to data in the user log; 

p 9 (b) responsive to determining that there is not a user log, initializing each 

J 1 0 C(I) and B(I) to zero (0); 

+ 11 (c) iteratively updating C(I) for the single search session such that: 

13 

0 12 C(I) = 1 , if image / is labeled as relevant; 

fU 

H 1 3 C{I) = -1 , if image / is labeled as irrelevant; and 

S s 

fU 14 C(I) = 0 , if C(I) is a non- feedback image; 

15 (d) updating each respective unigram frequencies as U(I) = U (I) + C(I) ; 

16 (e) updating each respective bigram frequency of an image pair such that: 

17 B(I, J) = B(I, J) + 1, if C(/)>0,C(J)>0, 

18 B(I,J) = B(I,J)-l, if C(I)>0,C(J)<0, 

1 9 B(I, J) = B(I, J) - 1 , if C(7) < 0, C(J) > 0, or 

20 5(7, J) = B(I, J) , otherwise; and 

21 wherein /, J are two images, and B(I, J) is their bigram frequency. 
22 
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15. A computer-readable medium for image retrieval using a statistical bigram 
correlation model, the computer-readable medium comprising computer- 
executable instructions for: 

receiving a plurality of images responsive to multiple search sessions; 

determining whether the images are semantically relevant images via 
relevance feedback; and 

estimating a respective semantic correlation between each of at least one 
pair of the images with a respective bigram frequency, each respective bigram 
frequency representing a probability of whether two of the images are 
semantically related to one-another based on a co-occurrence frequency that each 
image of the two images was relevant in a previous query/feedback session. 

16. A computer-readable medium as recited in claim 15, further comprising 
instructions for: 

assigning a respective ranking score to each of the images based at least in 
part on the respective semantic correlation corresponding to the image; and 
displaying only those images with a highest range of ranking scores. 

17. A computer-readable medium as recited in claim 15, further comprising 
instructions for, responsive to a search session, dynamically updating the 
respective bigram frequency corresponding to two of the images. 
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18. A computer-readable medium as recited in claim 15 5 wherein the respective 
semantic correlation is: (a) a positive correlation between two semantically 
relevant images; (b) a negative correlation between a semantically relevant image 
and a semantically irrelevant image; and (c) no correlation otherwise. 

19. A computer-readable medium as recited in claim 15: 

wherein the respective semantic correlation is performed offline or online 
to calculate unigram and bigram frequencies from relevance feedback information, 
the unigram frequency being based on relevance feedback to a session of the 
multiple search sessions, the unigram frequency indicating that each respective 
image of the images is either semantically relevant to the session, semantically 
less relevant to the session, or a non-feedback image with respect to the session; 
and 

wherein each respective bigram frequency is based on a pair of unigram 
frequencies. 

20. A computer-readable medium as recited in claim 15, wherein estimating 
the respective semantic correlation further comprises instructions for: 

associating a respective unigram frequency with each of the images, the 
unigram frequency indicating that each respective image of the images is either 
semantically relevant, semantically less relevant, or a non-feedback image, the 
unigram frequency being based on relevance feedback to a session of the multiple 
search sessions; and 

wherein each respective bigram frequency is based on a pair of unigram 
frequencies. 
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21. A computer-readable medium as recited in claim 15, wherein estimating 
the respective semantic correlation further comprises instructions for: 

associating a respective unigram frequency with each of the images, the 
unigram frequency indicating that each respective image of the images is either 
semantically relevant, semantically less relevant, or a non-feedback image, the 
unigram frequency being based on relevance feedback to a session of the multiple 
search sessions; 

determining a maximum frequency from a maximum value of the bigram 
and unigram frequencies; and 

wherein the respective semantic correlation is further based on the 
maximum frequency. 

22. A computer-readable medium as recited in claim 15, further comprising 
instructions for identifying, for each image obtained responsive to one or more 
search sessions of the multiple search sessions, a respective semantic support 
based on a similarity measure and/or the respective semantic correlation, the 
similarity measure corresponding to a similarity of a respective feature vector of 
the image and a search query corresponding to the session. 
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23. A computer-readable medium as recited in claim 15, further comprising 
instructions for: 

identifying, for each image obtained responsive to one or more search 
sessions of the multiple search sessions, a respective semantic support based on a 
similarity measure and/or the respective semantic correlation, the similarity 
measure corresponding to a similarity of a respective feature vector of the image 
and a search query corresponding to the session; 

assigning a respective ranking score to each of the images based upon the 
respective similarity measure, the respective semantic support, and a semantic 
weight; and 

displaying only those images with a highest range of respective ranking 

scores. 

24. A computer-readable medium as recited in claim 15, wherein estimating 
the respective semantic correlation is determined as follows: 

• 0 < R(I,J) < 1 

• R(I,J) = R(J,I) ; 

• if /=^and U(I) < 0: R(I,J) = 0; 

• if / * J and B(I, J) < 0: R(I,J) = 0 ; 

• if I=Jmd U(I) > 0: R(l,j) = U(I)/T ; or 

• if / * J and B(I, J) > 0 : R(l 9 j)= B(I)/T ; 

wherein I, J are two images, B(I,J) is their bigram frequency, U(I) is the 
unigram frequency of image I,T is the maximum frequency, R(I>J) is the 
correlation between image I and J. 
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1 25. A computer-readable medium as recited in claim 15, wherein each 

2 respective bigram frequency is based on a pair of unigram frequencies, and 

3 wherein the computer-executable instructions further comprise instructions for 

4 performing the respective semantic correlation offline by: 

5 (a) initializing all unigram and bigram frequencies to zero; 

6 (b) clustering search sessions with a same query into groups; 

7 ' (c) calculating unigram counts within a group; 

8 (d) updating unigram frequencies ; 
1^ 9 (e) updating bigram frequencies; 

o 10 (f) repeating operations (c), (d), and (f) for all session groups; 

1 1 (g) setting all negative unigram and bigram frequencies to zero; and 

-F 12 (h) calculating each respective semantic correlation based on results of (a) 

^13 through (f). 
W14 
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1 26. A computer-readable medium as recited in claim 15, wherein each 

2 respective bigram frequency is based on a pair of unigram frequencies, wherein 

3 C(7) is a unigram count of image 7, and wherein the computer-executable 

4 instructions further comprise instructions for performing the respective semantic 

5 correlation offline by: 

6 (a) initializing C(I) to zero (0); 

7 (b) iteratively updating C(I) for every session in a group such that: 
u 8 C(7) = C(7) + 1 , if image 7 is labeled as relevant in a session; 

O 9 C(7) = C(7) - 1 , if image 7 is labeled as irrelevant in a session; and 

J 10 C(7) is unchanged otherwise; 

H 5 1 1 (c) repeating (b) for every image of the images; 

fij 12 (d) updating each respective unigram frequencies as U(I) = U (I) + C(I) ; 

13 (e) updating each respective bigram frequency of an image pair such that: 

14 5(7, J) = B(I,J) + min{C(/),C(J)} , if C(7) > 0,C(J) > 0, 

15 B(I,J) = B(I,J) - min{C(7) -C(J)} , if C(7) > 0,C(J) < 0, 

16 5(7, J) = 5(7, J) - min{-C(7),C(J)} , if C(7) < 0,C(J) > 0, and 

17 5(7, J) = 5(7, J) , otherwise; and 

18 wherein 7 , J are two images, 5(7,7) is their bigram frequency, and 

19 U(I) is the unigram frequency of image I. 
20 
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27. A computer-readable medium as recited in claim 15, wherein each 
respective bigram frequency is based on a pair of unigram frequencies, and 
wherein the computer-executable instructions further comprise instructions for 
performing the respective semantic correlation online by: 

(a) calculating unigram counts in a particular search session; 

(b) updating unigram frequencies; 

(c) updating bigram frequencies; and 

(d) updating each respective semantic correlation between each of the 
images based on results of (a) through (c). 
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1 28. A computer-readable medium as recited in claim 15, wherein each 

2 respective bigram frequency is based on a pair of unigram frequencies, wherein 

3 C(I) is a unigram count of image /, wherein U(I) is a unigram frequency of 

4 image /, wherein 8(1, J) is a bigram frequency of image / and J, wherein a session 

5 group comprises a single search session, and wherein the computer-executable 

6 instructions further comprise instructions for performing the respective semantic 

7 correlation online by: 

8 (a) responsive to determining that there is a user log, updating calculating 

M. 9 each respective unigram and bigram frequency according to data in the user log; 

o 

"10 (b) responsive to determining that there is not a user log, initializing each 

% 1 1 C(I) and B(I) to zero (0); 

H> 12 (c) iteratively updating C(I) for the single search session such that: 

Q 

fu 1 3 C(7) = 1 , if image / is labeled as relevant; 

14 C(I) = —1 , if image / is labeled as irrelevant; and 

o I 

1 " 1 5 C(I) = 0 , if C(I) is a non-feedback image; 

1 6 (d) updating each respective unigram frequencies as U(I) = U (I) + C(7) ; 

17 (e) updating each respective bigram frequency of an image pair such that: 

1 8 B(I, J) = B(I, J) + 1 , if C(/) > 0, C{J) > 0, 

19 B(I, J) = B(I, J) - 1 , if C(/) > 0, C{J) < 0, 

20 B(I, J) = B(I, J) - 1 , if C(I) < 0, C(J) > 0, or 

2 1 B(I, J) = B(I, J) , otherwise; and 

22 wherein I, J are two images, and B(I, J) is their bigram frequency. 
23 
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29. A computing device for image retrieval using a statistical bigram 
correlation model, the computing device comprising: 

a processor; and 

a memory coupled to the processor, the memory comprising computer- 
executable instructions that are fetched and executed by the processor for: 

receiving a plurality of images responsive to multiple search 

sessions; 

determining whether the images are semantically relevant images via 
relevance feedback; and 

estimating a respective semantic correlation between each of at least 
one pair of the images with a respective bigram frequency, each respective bigram 
frequency being based on multiple search sessions in which each image of the pair 
is indicated to be a semantically relevant image. 

30. A computing device as recited in claim 29, further comprising instructions 
for: 

assigning a respective ranking score to each of the images based at least in 
part on the respective semantic correlation corresponding to the image; and 
displaying only those images with a highest range of ranking scores. 

31. A computing device as recited in claim 29, further comprising instructions 
for, responsive to a search session, dynamically updating the respective bigram 
frequency corresponding to two of the images. 
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32. A computing device as recited in claim 29, wherein the respective semantic 
correlation is: (a) a positive correlation between two semantically relevant images; 
(b) a negative correlation between a semantically relevant image and a 
semantically irrelevant image; and (c) no correlation otherwise. 

33. A computing device as recited in claim 29: 

wherein the respective semantic correlation is performed offline or online 
to calculate unigram and bigram frequencies from relevance feedback information, 
the unigram frequency being based on relevance feedback to a session of the 
multiple search sessions, the unigram frequency indicating that each respective 
image of the images is either semantically relevant to the session, semantically 
less relevant to the session, or a non-feedback image with respect to the session; 
and 

wherein each respective bigram frequency is based on a pair of unigram 
frequencies. 

34. A computing device as recited in claim 29, wherein estimating the 
respective semantic correlation further comprises instructions for: 

associating a respective unigram frequency with each of the images, the 
unigram frequency indicating that each respective image of the images is either 
semantically relevant, semantically less relevant, or a non-feedback image, the 
unigram frequency being based on relevance feedback to a session of the multiple 
search sessions; and 

wherein each respective bigram frequency is based on a pair of unigram 
frequencies. 
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35. A computing device as recited in claim 29, wherein estimating the 
respective semantic correlation further comprises instructions for: 

associating a respective unigram frequency with each of the images, the 
unigram frequency indicating that each respective image of the images is either 
semantically relevant, semantically less relevant, or a non-feedback image, the 
unigram frequency being based on relevance feedback to a session of the multiple 
search sessions; 

determining a maximum frequency from a maximum value of the bigram 
and unigram frequencies; and 

wherein the respective semantic correlation is further based on the 
maximum frequency. 

36. A computing device as recited in claim 29, further comprising instructions 
for identifying, for each image obtained responsive to one or more search sessions 
of the multiple search sessions, a respective semantic support based on a similarity 
measure and/or the respective semantic correlation, the similarity measure 
corresponding to a similarity of a respective feature vector of the image and a 
search query corresponding to the session. 
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1 37. A computing device as recited in claim 29, further comprising instructions 

2 for: 

3 identifying, for each image obtained responsive to one or more search 

4 sessions of the multiple search sessions, a respective semantic support based on a 

5 similarity measure and/or the respective semantic correlation, the similarity 

6 measure corresponding to a similarity of a respective feature vector of the image 

7 and a search query corresponding to the session; 

8 assigning a respective ranking score to each of the images based upon the 
M 9 respective similarity measure, the respective semantic support, and a semantic 
OlO weight; and 

HP 1 1 displaying only those images with a highest range of respective ranking 

+ 1 12 scores. 

La. 

j*Jl4 38. A computing device as recited in claim 29, wherein estimating the 

jU, 

■^,15 respective semantic correlation is determined as follows: 

ra 16 • 0<R(I,J)<1 

17 • R(I,J) = R(JJ); 

18 • if I=JmdU(I)<0. R(I, J) = 0; 

19 • if / * ^ and B(I,J) < 0 : R(I,J) = 0 ; 

20 • if I =Jand U (I) > 0: R(l,j)=U(I)/T; or 

21 • if / * J and B(I,J) > 0 : R(l,j) = B(I)/T ; 

22 wherein I, J are two images, B(I,J) is their bigram frequency, U(I) is the 

23 unigram frequency of image I,T is the maximum frequency, R(I,J) is the 

24 correlation between image I and J. 
25 
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39. A computing device as recited in claim 29, wherein each respective bigram 
frequency is based on a pair of unigram frequencies, and wherein the computer- 
executable instructions further comprise instructions for performing the respective 
semantic correlation offline by: 

(a) initializing all unigram and bigram frequencies to zero; 

(b) clustering search sessions with a same query into groups; 

(c) calculating unigram counts within a group; 

(d) updating unigram frequencies ; 

(e) updating bigram frequencies; 

(f) repeating operations (c), (d) 5 and (f) for all session groups; 

(g) setting all negative unigram and bigram frequencies to zero; and 

(h) calculating each respective semantic correlation based on results of (a) 
through (f). 



ru 
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40. A computing device as recited in claim 29, wherein each respective bigram 
frequency is based on a pair of unigram frequencies, wherein C(I) is a unigram 
count of image /, and wherein the computer-executable instructions further 
comprise instructions for performing the respective semantic correlation offline 
by: 

(a) initializing C(I) to zero (0); 

(b) iteratively updating C(I) for every session in a group such that: 

C(I) = C(I) + 1 , if image / is labeled as relevant in a session; 
C(I) = C(I) - 1 , if image / is labeled as irrelevant in a session; and 
C(I) is unchanged otherwise; 

(c) repeating (b) for every image of the images; 

(d) updating each respective unigram frequencies as U(I) = U(I) + C(I) ; 

(e) updating each respective bigram frequency of an image pair such that: 

B(I,J) = B(I,J) + min{C(/),C(7)} , if C(/) > 0,C(J) > 0, 
B(I,J) = B(I 9 J) - min{C(/) -C(J)} , if C(/) > 0,C(J) < 0, 
B(I,J) = B(I 9 J)-mm{-C(I),C(J)} , if C(I) < 0,C(J) > 0, and 
B{I,J) = B(I,J) , otherwise; and 

wherein I, J are two images, B(I,J) is their bigram frequency, and 
U(I) is the unigram frequency of image /. 
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41. A computing device as recited in claim 29, wherein each respective bigram 
frequency is based on a pair of unigram frequencies, and wherein the computer- 
executable instructions further comprise instructions for performing the respective 
semantic correlation online by: 

(a) calculating unigram counts in a particular search session; 

(b) updating unigram frequencies; 

(c) updating bigram frequencies; and 

(d) updating each respective semantic correlation between each of the 
images based on results of (a) through (c). 
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42. A computing device as recited in claim 29, wherein each respective bigram 
frequency is based on a pair of unigram frequencies, wherein C(7) is a unigram 
count of image 7, wherein U(I) is a unigram frequency of image 7, wherein 
B(I,J) is a bigram frequency of image 7 and J 9 wherein a session group comprises 
a single search session, and wherein the computer-executable instructions further 
comprise instructions for performing the respective semantic correlation online by: 

(a) responsive to determining that there is a user log, updating calculating 
each respective unigram and bigram frequency according to data in the user log; 

(b) responsive to determining that there is not a user log, initializing each 
C(I) and B(I) to zero (0); 

(c) iteratively updating C(I) for the single search session such that: 

C(7) = 1 , if image I is labeled as relevant; 

C(7) = -1 , if image 7 is labeled as irrelevant; and 

C(7) = 0 , if C(I) is a non- feedback image; 

(d) updating each respective unigram frequencies as U(I) = U(I) + C(7) ; 

(e) updating each respective bigram frequency of an image pair such that: 

B(I, J) = B(I, J) + 1 , if C(7) > 0, C(J) > 0, 
5(7, J) = 5(7, J) - 1 , if C(7) > 0, C(J) < 0, 
B(I,J) = B(I,J) - 1 , if C(7) < 0,C(J) > 0, or 
5(7, J) = B(I, J), otherwise; and 

wherein 7, J are two images, and B{I, J) is their bigram frequency. 
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43. A computing device image retrieval using a statistical bigram correlation 
model, the computing device comprising: 

processing means for: 

receiving a plurality of images responsive to multiple search 

sessions; 

determining whether the images are semantically relevant images via 
relevance feedback; and 

estimating a respective semantic correlation between each of at least 
one pair of the images with a respective bigram frequency, each respective bigram 
frequency being based on multiple search sessions in which each image of the pair 
is indicated to be a semantically relevant image. 

44. A computing device as recited in claim 43, further comprising means for: 
assigning a respective ranking score to each of the images based at least in 

part on the respective semantic correlation corresponding to the image; and 
displaying only those images with a highest range of ranking scores. 

45. A computing device as recited in claim 43, further comprising means for, 
responsive to a search session, dynamically updating the respective bigram 
frequency corresponding to two of the images. 
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46. A computing device as recited in claim 43, wherein the respective semantic 
correlation is: (a) a positive correlation between two semantically relevant images; 
(b) a negative correlation between a semantically relevant image and a 
semantically irrelevant image; and (c) no correlation otherwise. 

47. A computing device as recited in claim 43 : 

wherein the respective semantic correlation is performed offline or online 
to calculate unigram and bigram frequencies from relevance feedback information, 
the unigram frequency being based on relevance feedback to a session of the 
multiple search sessions, the unigram frequency indicating that each respective 
image of the images is either semantically relevant to the session, semantically 
less relevant to the session, or a non-feedback image with respect to the session; 
and 

wherein each respective bigram frequency is based on a pair of unigram 
frequencies. 

48. A computing device as recited in claim 43, wherein the processing means 
for estimating the respective semantic correlation further comprises means for: 

associating a respective unigram frequency with each of the images, the 
unigram frequency indicating that each respective image of the images is either 
semantically relevant, semantically less relevant, or a non-feedback image, the 
unigram frequency being based on relevance feedback to a session of the multiple 
search sessions; and 

wherein each respective bigram frequency is based on a pair of unigram 
frequencies. 
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49. A computing device as recited in claim 43 , wherein the processing means 
for estimating the respective semantic correlation further comprises means for: 

associating a respective unigram frequency with each of the images, the 
unigram frequency indicating that each respective image of the images is either 
semantically relevant, semantically less relevant, or a non-feedback image, the 
unigram frequency being based on relevance feedback to a session of the multiple 
search sessions; 

determining a maximum frequency from a maximum value of the bigram 
and unigram frequencies; and 

wherein the respective semantic correlation is further based on the 
maximum frequency. 

50. A computing device as recited in claim 43, further comprising processing 
means for identifying, for each image obtained responsive to one or more search 
sessions of the multiple search sessions, a respective semantic support based on a 
similarity measure and/or the respective semantic correlation, the similarity 
measure corresponding to a similarity of a respective feature vector of the image 
and a search query corresponding to the session. 
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53. A computing device as recited in claim 43, wherein each respective bigram 
frequency is based on a pair of unigram frequencies, and wherein the processing 
means further comprise means for performing the respective semantic correlation 
offline by: 

(a) initializing all unigram and bigram frequencies to zero; 

(b) clustering search sessions with a same query into groups; 

(c) calculating unigram counts within a group; 

(d) updating unigram frequencies ; 

(e) updating bigram frequencies; 

(f) repeating operations (c) 5 (d), and (f) for all session groups; 

(g) setting all negative unigram and bigram frequencies to zero; and 

(h) calculating each respective semantic correlation based on results of (a) 
through (f). 
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54. A computing device as recited in claim 43, wherein each respective bigram 
frequency is based on a pair of unigram frequencies, wherein C(7) is a unigram 
count of image /, and wherein the processing means further comprise means for 
performing the respective semantic correlation offline by: 

(a) initializing C(I) to zero (0); 

(b) iteratively updating C(I) for every session in a group such that: 

C{I) = C(7) + 1 , if image 7 is labeled as relevant in a session; 
C(I) = C(7) - 1 , if image 7 is labeled as irrelevant in a session; and 
C(7) is unchanged otherwise; 

(c) repeating (b) for every image of the images; 

(d) updating each respective unigram frequencies as U{I) = £/(7) + C(7) ; 

(e) updating each respective bigram frequency of an image pair such that: 

B(I,J) = £(7, J) + min{C(/),C(J)} , if C(7) > 0 9 C(J) > 0, 
B{I,J) = B(I, J) -min{C(7) -C(J)} , if C(7) > 0,C(J) < 0, 
B(I,J) = 5(7, J) - min {-C(7), C (J) } , if C(7) < 0,C(J) > 0, and 
5(7, J) = B(I, J) , otherwise; and 

wherein 7, J are two images, 5(7, J) is their bigram frequency, and 
U (7) is the unigram frequency of image 7. 
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55. A computing device as recited in claim 43, wherein each respective bigram 
frequency is based on a pair of unigram frequencies, and wherein the processing 
means further comprise means for performing the respective semantic correlation 
online by: 

(a) calculating unigram counts in a particular search session; 

(b) updating unigram frequencies; 

(c) updating bigram frequencies; and 

(d) updating each respective semantic correlation between each of the 
images based on results of (a) through (c). 
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56. A computing device as recited in claim 43 , wherein each respective bigram 
frequency is based on a pair of unigram frequencies, wherein C(7) is a unigram 
count of image I f wherein U(I) is a unigram frequency of image 7, wherein 
5(7, J) is a bigram frequency of image I and J, wherein a session group comprises 
a single search session, and wherein the processing means further comprise means 
for performing the respective semantic correlation online by: 

(a) responsive to determining that there is a user log, updating calculating 
each respective unigram and bigram frequency according to data in the user log; 

(b) responsive to determining that there is not a user log, initializing each 
C(I) and B(I) to zero (0); 

(c) iteratively updating C(I) for the single search session such that: 

C(7) = 1 , if image 7 is labeled as relevant; 

C(7) = -1 , if image 7 is labeled as irrelevant; and 

C(7) = 0 , if C(I) is a non- feedback image; 

(d) updating each respective unigram frequencies as U(I) = U(I) + C(7) ; 

(e) updating each respective bigram frequency of an image pair such that: 

5(7, J) = 5(7, J) + 1 , if C(/) > 0, C(J) > 0, 
B(I,J) = 5(7, J) -1 , if C(7) > 0,C(J) < 0, 
5(7, J) = 5(7, J) -1 , if C(7) < 0,C(J) > 0, or 
5(7, J) = 5(7, J), otherwise; and 

wherein I, J are two images, and 5(7, J) is their bigram frequency. 
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